United States Patent im 



Kline 



nnoinnuiiiiiioii 

US005793747A 
[ii] Patent Number: 5,793,747 
[45] Date of Patent: Aug. 11, 1998 



[54] EVENT-DRIVEN CELL SCHEDULER AND 
METHOD FOR SUPPORTING MULTIPLE 
SERVICE CATEGORIES IN A 
COMMUNICATION NETWORK 

[75] Inventor Richard Kline. E. Walpole, Mass. 

[73] Assignee: Motorola, Inc. Schaumburg, I1L 

[21] Appl. No.: 616,147 

[22] Hied: Mar. 14, 1996 



[51] 
[52] 
[58] 



[56] 



Int Q. 6 - « «. H04J 1/16 

U.S. CL _ 370/230; 37W412 

Field of Search 370/395, 412-413, 

370/415. 414. 229, 230-235, 429, 428, 
416, 418, 417 

References Cited 

U.S. PATENT DOCUMENTS 



5.497,375 3/1996 Hluchyj et al. . 

5415363 5/1996 Ben-Nun et al. 

5,533,020 7/1996 Byieetal 

5,537,408 7/1996 Branstad et al. 



370/395 

370/395 

370/395 

..... 370/395 



OTHER PUBLICATIONS 

ATM "User-Network Interface Specification", Version 3.0. 
Fred Saramartino. 

The ATM Forum Newsletter, Oct., 1995 voL 3, Issue 4 u 53 
Bytes". 

The ATM Forum, Technical Committee. 'Traffic Manage- 
ment Specifications", Version 4.0. Feb.. 1996. 

Primary Examiner— -Douglas W. Olms 
Assistant Examiner—Apt Patel 

Attorney Agent, or Firm— Darleen J. Stockley; Jeffrey T. 
Klayman 



[57] 



ABSTRACT 



The event scheduler (100; 200) and method (300) of the 
present invention solve the problem of mixing multiple 
service categories on the same physical link or media by 
utilizing a calendar queue scheduling method (Le., based on 
prior actual transmission times of previous packets). The 
event-driven cell «scK«lule7 is, for example used in an 
asynchronous transfer mod e ATM network and may, for 
example, be embodied inTso^arernardware T and r firmware. 

23 Claims, U Drawing Sheets 
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UTILIZING A PACKET BUFFER MEMORY HAVING A 
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IN STEP 606, ON FIRST CELL ARRIVAL. WHERE A TIME NOW 
IS GREATER THAN TIME EARLIEST, UPDATING TIME EARLIEST 
EQUAL TO TIME NOW, WHERE TIME NOW IS AN OUTPUT OF A 
REAL TIME CLOCK, AND STORING UPDATED TIME EARLIEST IN 
THE PER CONNECTION CONTEXT MEMORY 



804 



IN STEP 620. UPDATING TIME EARLIEST TO TIME EARLIEST 
PLUS CELL PERIOD. WHERE CELL PERIOD IS A RECIPROCAL OF 
A PEAK CELL RATE AND STORING UPDATED TIME EARLIEST IN 
THE PER CONNECTION CONTEXT MEMORY 
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ENQUEUING, BY A MEMORY CONTROLLER, THE PACKETS IN A PLURALITY OF PER 
CONNECTION DATA QUEUES IN AT LEAST ONE CELL MEMORY, WHEREIN EACH QUEUE 

HAS A QUEUE ID 



NOTl FY1NG, BY THE MEMORY CONTROLLER, AT LEAST ONE MULTISERVICE CATEGORY 
SCHEDULER, WHERE A DATA QUEUE IS EMPTY IMMEDIATELY PROIR TO THE MEMORY 
CONTROLLER ENQUEUING THE PACKETS, THAT A FIRST ARRIVAL HAS OCCURRED 
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CONNECTION CONTEXT MEMORY 
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REMOVING, BY A PRIORITY TASK DECODER, AT A TIME EQUAL TO OR GREATER 
THAN TIME EARLIEST IN ACCORDANCE WITH A TIME OPPORTUNITY, THE TASK FROM 
THE PRIORTTYTASK QUEUE AND GENERATING A REQUEST TO THE MEMORY CONTROLLER 
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UPDATED PRKDRfTY INDEX BASED ON SERVICE CATEGORY AND PRESENT STATE 
INFORMATION ASSOCIATED WITH THE CONNECTION, AND UPDATING AND STORING 
PRESENT STATE INFORMATION IN THE PER CONNECTION CONTEXT MEMORY 
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GENERATING, WHERE THE PER CONNECTION QUEUE IS UNEMPTY, A NEW TASK 
USING THE UPDATED TIME EARLIEST, BY THE CALCULATION UNIT, FOR THE 
CONNECTION AND RETURNING TO STEP 610, OTHERWISE, WHERE THE PER 
CONNECTION IS EMPTY, WAITING FOR THE NOTIFICATION 
BY THE MEMORY CONTROLLER AND RETURNING TO STEP 606 
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CALCULATING, BY THE CALCULATION UNIT, AN UPDATED TIME 
EARLIEST AND AN UPDATED PRIORITY INDEX BASED ON 
SERVICE CATEGORY AND PRESENT STATE INFORMATION ASSOCIATED 
WITH THE COM>JECnON, AND UPDATING AND STORING PRESENT 
STATE INFORMATION IN THE PER CONNECTION CONTEXT MEMORY 
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CONNECTION, THE PRESENT VALUE OF THE 
REAL TIME CLOCK TIME NOW AhD STATE 
INFORMATION ASSOCIATED WITH THE 
CONNECTION THAT IS STORED IN THE PER 
CONNECTION CONTEXT MEMORY 
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FOR UNSPECIFIED BIT RATE (UBR) PACKET TRAFFIC 
IN A CELL-BASED SWITCH, THE FOLLOWING 
STEP IS INCLUDED: 
UPDATING TIME EARUESTTOTIME NOW 
PLUS CELL PERIOD, WHERE CELL PER1CO IS 
A RECIPROCAL OF A PEAKCELL RATE AND 
STORING UPDATED TIME EARLIEST IN THE 
PER CONNECTION CONTEXT MEMORY 



FOR AVAILABLE BIT RATE, ABR, PACKET TRAFFIC 
IN A PACKET SWITCH, 
A) UPDATING TIME EARLIEST USING A 
PREDETERMINED FUNCTION OF THE NEGOTIATED TRAFFIC 
PARAMETERS FCfl THE CONNECTION, A PRESENT VALUE 

CfAP£AL TIME CLOCK TIME NOW AND ASSOCIATED 
PREDETERMINED STATE INFORMATION THAT IS STORED 
IN T>€F€fl CONNECTION CONTEXT MEMCflY; 
B) USING A PREDETERMINED ALGORITHM, SUCH AS A LEAKY 
BUCKET ALGORITHM TO DETERMINE IF THE ACTUAL TRANSMISSION 
PACKET RATE AT THE OUTPUT OF THE PACKET MULTIPLEXER 
IS FALLING BELOW THE NEGOTIATED MINIMUM PACKET RATE, MCR, FOR 
THE CONNECTION; ANDQ SETTING THE PHORITY INDEX TO ONE OF AT 
LEAST TWO DIFFERENT PRIORnY LEVELS AS A PREDETERMINED 
FUNCTION OF THE ACTUAL PACKET HATE DETERMINED IN STEP B 
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FOR VARIABLE BIT RATE, VBR, PACKET TRAFFIC IN A PACKET 
SWITCH, THE FCUOWING STEPS ARE INCLUDED: 
A) USING A F>REDETERMINED ALGCWTHMTO DETERMINE WHETHER THE 
ACTUAL TRANSMISSION PACKET RATE AT THE OUTPUT OF THE PACKET MULTIPLEXER 

FALLS BELOW A NEGOTIATED SUSTAJ NABLE PACKET RATE, SCR, FOR THE 
CONNECTION. B) USING A PREDETERMINED ALGORfTHM TO DETERMINE WHETHER THE 
ACTUAL TRANSMISSION PACKET RATE AT AN OUTPUT OF THE PACKET MULTIPLEXER 
IS EXCEEDING A BURST UMT, MBS, FOR THE CONNECTION; 

C) UPDATING TIME EARUEST USING A PREDETERMINED FUNCTION OF 
^EG0T1ATED TRAFRC PARAMETERS FOR THE CC^^WFX^^O^I ) A P 

A REALTIME CLOCKTIME NOW, OUTPUTS OF STEPS A AND B ABOVE, AND 
PREDETERMNED ASSOCIATED STATE I NFORMATION FOR THE CONNECTION THAT IS 
STORED IN THE PER CONNECTION CONTEXT MEMORY; 

D) SETTING THE PPJOPJTY INDEX TO 0^ OF AT LEAST TWO OF^FE 
PRIORITY LEVELS AS A PREDETERMINED FUNCTION OF THE ACTUAL TRANSMISSION 

PACKET RATE AT THE OUTPUT OF THE PACKET MULTIPLEXER 
DETERMINED IN STEPS A AND B 
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IN STEP 606. ON FIRST CELL ARRIVAL, WHERE A TIME NOW IS 
GREATER THAN TIME EARLIEST, UPDATING TIME EARLIEST EQUAL 
TO TIME NOW. WHERE TIME NOW IS AN OUTPUT OF A REAL TIME 
CLOCK. AND STORING UPDATED TIME EARLIEST IN 
A PER CONNECTION CONTEXT MEMORY 



1 


1004 

( 


IN 
CELL 


STEP 620. UPDATING TIME EARLIEST TO TIME NOW 
PERIOD. WHERE CELL PERIOD IS A RECIPROCAL OF 
CELL RATE AND STORING UPDATED TIME EARLIEST 
THE PER CONNECTION CONTEXT MEMORY 


PLUS 
A PEAK 
IN 



1000 

FIG. lO 



03/14/2004, EAST Version: 1.4.1 



U.S. Patent 



Aug. 11, 1998 



Sheet 8 of 11 



5,793,747 



IN STEP 606, ON FIRST CELL ARRIVAL, WHERE A TIME NOW IS 
GREATER THAN TIME EARLIEST, UPDATING TIME EARLIEST 
EQUAL TO TIME NOW, WHEFE TIME NOW IS AN OUTPUT OF A 
REAL TIME CLOCK, AND STORING UPDATED TIME EARLIEST IN A 
PER CONNECTION CONTEXT MEMORY AND SETTING A RESET 
FLAG TOTRUE IN A PER CONNECTION CONTEXT MB/CRY 
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IN STEP 620; 

A) WHERE RESET FLAG IS EQUAL TOTRUE, SETTING 
RESET FLAG TO FALSE AND SETTING THRESHOLD EQUAL TO 
TIME EARLIEST PLUS {A PREDETERMINED CONSTANT TIMES A 

RECIPROCAL Of A PREDETERMINED MINIMUM CELL RATE) IN THE PER 
COM4EC31CN CONTEXT MEMCWAhDVVHE 
TOFAI^SETnNGTHFESHCU)ECUALTOTHRESHCtDPLUSA 
RECIPROCAL OF A PREDETERMINED MINIMUM CELL RATE; 

B) UPDATING TIME EARLIEST TO TIME NOW PLUS CELL 
PERIOD, WHERE CELL PERIOD IS A RECIPROCAL OF A PEAK CELL RATE 

AND STORING UPDATED TIME EARLIEST IN THE PER 
CONNECTION CONTEXT MEMORY; 
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IN STEP 620, 

AND WHERE NOTIFIED IN STEP 618 THAT A PER CONNECTION 
PACKET QUEUE WAS UNEMPTY 
A) WHERE TIME NOW IS GREATER THAN THRESHOLD, 
SETTING THE PRIORITY INDEX TO A VALUE INDICATING A HIGH 

PFBORTTYABR TASK QUEUE; 
B) WHERE TIME NOW IS LESS THAN OR EQUAL TO THRESHOLD, 
B1) SETTING THE PRIORITY INDEX TOA VALUE 
INDICAT1 NG A NORMAL PFSORfTY ABR TASK QUEUE; 
B2) WHERE THRESHOLD IS GREATER THAN TIME 
NOW PLL6 {A PREDETERMINED CONSTANT MULTIPLIED BY A 
RECIPROCAL OF A PREDETERMINED MINIMUM CELL RATE), SETTING 
THRESHOLD EQUAL TO TIME NOW PLUS {THE CONSTANT 
MULTIPIUED BY THE RECIPROCAL OF THE 
PREDETERMINED MINIMUM CELL RATE} 
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IN STEP 606, ON FIRST CELL ARRIVAL, WHERE A TIME NOW IS 

GREATER THAN TIME EARLIEST, 
A) UPDATING TIME EARLIEST EQUAL TO TIME NOW. WHERE TIME 
NOW IS AN OUTPUT OF A REAL TIME CLOCK, AND STORING UPDATED TIME 
EARLIEST IN A PER CONNECTION CONTEXT MEMORY AND 
B) SETTING A RESET FLAG TO TRUE IN A PER CONNECTION 

CONTEXT MEMORY; 
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IN STEP 620. 

A) WITH RESPECT TO THE RESET FLAG. 

A1) WHERE RESET FLAG IS EQUAL TO TRUE. 

A1a) SETTING RESET FLAG TO FALSE 
Alb) AND SETTING THRESHOLD EQUAL TO TIME ^ 
EARLIEST PLUS JA PREDETERMINED CONSTANT TIMES A RECIPROCAL OF 
A PREDETERMINED SUSTAINABLE CELL RATE] IN THE PER 
CONNECTION CONTEXT MEMORY; 

A1c) AND WHERE A THEORETICAL TRANSMISSION 
TIME TTT IS LESS THAN TIME NOW. SETTING TTT= TIME NOW; 

A2) WHERE RESET FLAG IS EQUAL TO FALSE. _ 
SETTING THRESHOLD EQUAL TO THRESHOLD PLUS A RECIPROCAL OF THE 
PREDETERMINED SUSTAINABLE CELL RATE (SCR); 

AND 

B) UPDATING TIME EARLIEST TO TIME NOW PLUS CELL PERIOD, 
WHERE CELL PERIOD IS A RECIPROCAL OF A PREDETERMINED PEAK 
CELL RATE (PCRl AND STORING UPDATED TIME EARLIEST IN THE 
PER CONNECTION CONTEXT MEMORY; 

AND C) WHERE NOTIFIED IN STEP 618 THAT A PER CONNECTION 
PACKET QUEUE WAS UNEMPTY, 

C1) UPDATING A THEORETICAL TRANSMISSION TIME (TTT) 
TO A VALUE OF TTT PLUS THE RECIPROCAL OF THE SUSTAINABLE 
CELL RATE (SCR) AND STORING THE UPDATED TTT IN THE PER 
CONNECTION CONTEXT MEMORY; 
C2) WITH RESPECT TO TIME NOW AND THRESHOLD. 
C2o) WHERE TIME NOW IS GREATER THAN 

THRESHOLD. SETTING THE PRIORITY INDEX EQUAL TO A VALUE 
INDICATING A HIGH PRIORITY VBR TASK QUEUE; 

C2b) WHERE TIME NOW IS LESS THAN OR EQUAL TO THRESHOLD, 

C2b1) SETTING THE PRIORITY INDEX 
EQUAL TO VALUE INDICATING A NORMAL PRIORITY VBR TASK QUEUE; 

C2b2) WHERE THRESHOLD IS GREATER TO THRESHOLD 
THAN TIME NOW PLUS A PREDETERMINED CONSTANT TIMES A RECIPROCAL 
OF A PREDETERMINED SUSTAINABLE CELL RATE (SCR). SETTING ^ 
THRESHOLD EQUAL TO TIME NOW PLUS A PREDETERMINED CONSTANT TIMES 
A RECIPROCAL OF A PREDETERMINED SUSTAINABLE CELL RATE (SCR). 

AND C2b3) WHERE TIME EARLIEST IS LESS 
THAN TTT MINUS A PREDETERMINED MAXIMUM BURST SIZE CONSTANT 
TMBS, SETTING TIME EARLIEST EQUAL TO TTT MINUS A PREDETERMINED 
MAXIMUM BURST SIZE CONSTANT TMBS. 
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UTILIZING A SET OF PRIORITY TASK QUEUES AND A HEAD OF LINE 
PRIORITY DECODER/DEMULTIPLEXER AT THE OUTPUT OF THE 

TASK QUEUES. 
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UTILIZING A SET OF PRIORITY TASK QUEUES AND A PRIORITY 
DECODER/DEMULTIPLEXER ARRANGED TO PROVIDE A COMBINATION 
OF HEAD OF LINE PRIORITY AND WEIGHTED ROUND 
ROBIN QUEUING DISCIPLINES. 
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EVENT-DRIVEN CELL SCHEDULER AND outgoing link for a communication network in accordance 

METHOD FOR SUPPORTING MULTIPLE with the present invention. 

SERVICE CATEGORIES IN A FIG. 5 is a functional view of the event scheduler for 

COMMUNICATION NETWORK scheduling transmission times for a plurality of cells on an 

5 outgoing link for a communication network in accordance 
CO-FENDING APPLICATIONS with the present invention. 
The present application may be related to co-pending FIG. 6 is a flow chart showing another arAodiment of 
appUcations that are being filed concurrently: U.S. applica- steps of a method for scheduling transmission times for a 
tion Ser. No. 08/616,024 filed Mar. 14. 1996, EFFICIENT plurality of cells on an outgoing link for a communication 
OUTPUT-REQUEST PACKET SWITCH AND METHOD, network in accordance with the present invention, 
by Craig Sheppard Holt, Richard Kline, and Krishnan FIG. 7 shows additional steps for utilizing the method of 
Ramakrishnan; and U.S. ajjplication Ser. No. 08/616,029 the present invention in constant bit rate (CBR), available bit 
filed Mar. 14, 1996, METHOD AND DEVICE FOR MUL- rate (ABR). variable bit rate (VBR), and unspecified bit rate 
TIPOINT SWITCHING AND ARBITRATION IN 15 (UBR) packet traffic in a cell-based switch. 
OUTPUT-REQUEST PACKET SWTTCH, by Craig Shep- nG. 8 shows additional steps for utilizing the method of 
paid Holt, Richard Kline, and Krishnan Ramakrishnan. the present invention in constant bit rate (CBR) packet traffic 
in a cell-based switch. 

FIELD OF THE INVENTION nG 9 mustratcs a t^ne for the operation of a Sched- 

The present invention relates to asynchronous transfer 20 uler utilizing the specific steps of FIG. 8 for a CBR con- 
mode switching systems and more particularly, to schedul- nection. 

ing transmission times for cells in asynchronous transfer FIG. 10 shows additional steps for utilizing the method of 
mode switching systems. the present invention in unspecified bit rate (UBR) packet 

traffic in a cell-based switch. 
BACKGROUND OF THE INVENTION 25 piG. 11 shows additional steps for utilizing the method of 

In packet-based networks such as asynchronous transfer the present invention in available bit rate (ABR) packet 
mode (ATM) networks, a maximum transmission bit rate traffic in a cell-based switch. 

may be set up, for example, by utilizing packets that have FIG. 12 illustrates a timeline for the operation of a 
constant lengths per unit of time. Constant length packets are ^ Scheduler utilizing the specific steps of FIG. 11 for an ABR 
referred to as cells. In networks that mix multiple service connection. 

categories on a same physical link or media, traffic shaping FIG. 13 shows additional steps for utilizing the method of 
is problematic. Traditional methods rely on Usage Parameter the present invention in variable bit rate (VBR) packet traffic 
Control (UPC), i.e., Slicing", on ingress ports, followed in a cell-based switch. 

by cell enqueuing with selective cell discard on egress ports, 35 FIG. 14 is a flow chart showing one embodiment of steps 
followed by simple Head Of line Priority (HOLP) mecha- for priority decoding in accordance with the present inven- 
nisms on egress ports for selectively dequeuing cells for tion. 

transmission. Weighted Round Robin (WRR) polling ser- 

vice disciplines have been proposed for mixing traffic with DETAILED DESCRIPTION OF A PREFERRED 

different service requirements, but may become difficult at ^ EMBODIMENT 
high speeds when hundreds or thousands of connections j S a network data transmission system and 

need to be multiplexed. methodology/protocol and is described in the ATM User- 

The difficulty arises because the WRR is a polling mecha- Network Interface Specification. Version 3.0, by the ATM 
nism that requires multiple polls to find a queue that requires Forum, published by Prentice-Hall in 1993 and related 
service. Since each poll requires a fixed amount of work, it 45 specifications and other publications authored by the ATM 
becomes impossible to poll at a rate that accommodates an Forum, ATM enables diverse information traffic types, such 
increased number of connections. In particular, when many as voice/audio, data and video to efficiently share a common 
connections from bursty data sources are idle for extended transmission path and switching elements in Virtual Con- 
periods of time, many negative polls may be required before nections (VCs) therethrough between ATM traffic sources 
a queue is found that requires service. 50 and destinations. All ATM traffic is formatted into fixed size 

Thus, there is a need for an event-driven cell scheduler for user cells having defined headers (interpreted by the ATM 
supporting multiple service categories in an asynchronous network for controlling the switching the cells through the 
transfer mode ATM network. network) and payloads (containing user data, not interpreted 

by the network), so that diverse transmission rates may be 
BRIEF DESCRIPTION OF THE DRAWINGS 55 accommodated without complex synchronization functions. 

ATM has the potential for supporting diverse traffic with 

FIG. 1 is a block diagram of an event-dnven VP/VC mciing tolerances for delay, jitter and cell loss, and dif- 
(virtual r*th/virtual circuit) multiplexer having an event f . muiitmcnts for bandwidth or throughput 
scheduler in accordance with the present invention. ^ ^ regar(L ^ Detworks m specified to support a 

FIG. 2 is a block diagram of an event scheduler in ^ num ber of traffic service categories, including Constant Bit 
accordance with the present invention. Rate (CBR), Variable Bit Rate (VBR). Available Bit Rate 

FIG. 3 is a flow chart showing one embodiment of steps (ABR) and Unspecified Bit Rate (UBR). The different 
for a method for scheduling transmission times for a plu- service categories each have associated ATM traffic param- 
rality of cells on an outgoing link for a communication eters which describe the time series of cells emitted by the 
network in accordance with the present invention. 65 various types of sources. CBR sources are described by the 

FIG. 4 is a block diagram of an event scheduler for following two traffic descriptors: a Peak Cell Rate (PCR), 
scheduling transmission times for a plurality of cells on an which is uie maximum rate that the source will emit cells. 



03/14/2004, EAST Version: 1.4.1 



5,793,747 

3 4 

and a Cell Delay Variation (CDV) which is the amount of of traffic parameters, such as a required SCR or MBS. ox a 

cell jitter, or variance from uniformly spaced cells (in time). specific guaranteed QoS parameter (such as a maiirnmp 

VBR sources are described by a PCR, a Maximum Burst and/ox mean cell delay) cannot be readily defined. The 

Size (MBS) which is the maximum number of cells which nature and constraints of the ABR service category as 

will be sent at a rate equal to the PCR (before a subsequent 5 presently envisioned is described further by F. Bonomi in 

idle period), and a Sustainable Cell Rate (SCR) which is l<The Available Bit Rate Service**, 53 Bytes (The ATM 

roughly equivalent to a long term average cell rate. ABR Forum Newsletter), v. 3, n. 4, October 1995. incorporated 

sources are described by a PCR and an Minimum Cell Rate hcrcin bv rcfcrcnce - Further information on the service 

(MCR) which is a rninimum cell rate that the ABR source categories, traffic parameters, and quality of service param- 

has contracted with the network (i.e.. an ABR is always 10 % tm ™J be found ^ n the "Traffic Management 

allowed to emit cells at a rate that is at least as large as the f ^^^k^^ 0 ' *™ ^J^ 95 ' 0 ^ 3 ^ 10 ' 

MCR). Furthermore, the ABR source may opeSe at an J*"* Vote ' fttaM * 1995 ' ™<*P<*** nerem by refer- 

Actual Cell Rate (ACR) which is between the PCR and the * . ri . A . . , . . 

MCR. The ACR is explicitly controlled (throughout the J^^J^£^ 

traffic etoenptors and therefore the behavior of UBR sources or M s^^g meffiod The event scheduler may be 

is totally unspecified and unknown (to the network). embodied in software, hardware and firmware. 

In general, the ATM system architecture is designed such An event is defined as the process of removing a cell from 

that an ATM network can mix traffic from these various a queue and the subsequent transmission of the cell on a link 

service categories onto a single common physical network 20 of an ATM network A task is defined as a "scheduled" event 

link (transmission media) while guaranteeing specific Qual- A task object has a predetermined number of parameters 

ity of Service (QoS) guarantees to the diverse traffic sources. associated with it, such as a desired execution time, a queue 

CBR sources are guaranteed by the ATM network, provided identification, ie.. queue ID. that indicates which data queue 

a source doesn't exceed its traffic contract (described by will be serviced when the task is executed, and a task 

traffic parameters PCR and CDV) that the network will 25 priority. That is, there may be many pending tasks waiting 

deliver all cells to the final destination with a guaranteed f or execution. The execution of a task at a specific time 

maximum cell delay (maximum time between the time a cell instant is equivalent to an event 

is emitted at a source to the time that the cell is delivered to FlG ' l - numeral 1#0, is a block diagram of an event- 

the destination) with a small Cell Loss Ratio (CLR) and with drivcn vp/vc (virtual path/virtual connection) multiplexer 

a specified CDV at the destination (where CDV is usually 30 having an event scheduler in accordance with the present 

on the order of the source's CDV, though usually somewhat invention. Cells arrive at the VP/VC routing unit (102), 

larger) and specified guaranteed CLR, where typical CLRs a multiplexer and are routed to a queue of a 

are on the order of 1(T 3 to 1(T 12 ). plurality of queues (104) utilizing a cell multiplexer, in 

. ... - accordance with the information in the cell header. Where 

VBR sources are guarantee^ prow«JedAat a source fte h M fl empty when the cell arrives, the 

doesn t exceed its traffic contort (described by traffic ceU is added to thTque^e. Where the queue is empty, the cell 

F?T TaJF^' *. isao^toftequ^atKlarequesttoschedulelLtevent 

deliver all cellsto the final des&nahon with a small CLR and (U0) fc ^ £ ^ (108) 

with a guaranteed mean cell transfer delay, which is roughly ' _ ... . , . . ' . . ^ . 

■ r , „ . , . * ^ j ° ' This request results in a task being generated and stored 

equivalent to an average delay through the network. . ~.V? . . . _f vT* VTT1.T . ., 

40 (queued) inside the event scheduler. Each task typically 

ABR sources are guaranteed, provided that a source indudcs ^ lcasfc a execution ^ ma i indicates the 

doesn't exceed its traffic contract (described by traffic earliest execution time, a queue identification (ID) field, and 

parameters PCR and MCR) and provided that the source a fiddThe task is executed at a time equal to or 

responds appropriately (per ABR reference behavior) to the greater than the time stamp that is associated with the task, 

explicit rate network feedback, adjusting its ACR 4J The priority field is used to resolve contention between tasks 

accordingly, that the network will deliver all cells to the final with me ^ , u ^ highest priority task will 

destination with a small CLR. Furthermore, ABR sources exeC ute first). The queue ID field includes information 

are guaranteed, by the network, that available network specifying wnich ^ queue ^ ^ when ^ tek 

capacity wiU be fairly shared among aU ABR sources is executed. The output of the event scheduler consists of 

which may be emitting cells during a specific tune instant x events (U4). An event is generated when the event scheduler 

CBR and real time VBR traffic categories are intended to executes a task. The event contains a queue number (queue 

address applications, e.g., circuit emulation and entertain- ID). The event is then sent to the cell multiplexer (106). The 

ment quality video, with precisely defined requirements for cell multiplexer requests the cell from the queue indicated 

throughputs and delays. The UBR traffic category is by the queue ID; the cell is sent via the cell multiplexer (106) 

intended for applications like data file transfers with mini- 55 to the outgoing ATM port and tests the queue after removing 

mal service requirements. Although UBR traffic is the cell to determine whether the queue is empty. Where the 

supported, there are no service guarantees for UBR connec- queue is unempty, then the cell multiplexer sends a request, 

tions. If bandwidth is available on the ATM network or any where the request includes the queue ID. Other information 

ATM link of the network after allocation among CBR, VBR, necessary for developing an optimum scheduler may also be 

and ABR traffic, UBR traffic will be accommodated. A ^ sent, such as the cell loss priority (CLP) bit of the next cell 

network operator may also gratuitously guarantee that a in the queue. The CLP bit indicates whether the cell is to be 

certain percentage of the network capacity is reserved for considered a high priority or low priority cell if and when the 

UBR sources. network is congested and some cells may need to be 

The ABR traffic service category is intended to economi- discarded, 

cally support applications with vague requirements for 65 The event scheduler (108) generates an event (114) when 

throughputs and delays, particularly traffic from certain it executes a task. The event is a request for a cell from a 

types of data sources (data applications), where a specific set specific queue. 
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The requests to schedule an event are typically received counter (220). i.e.. a real time clock, increments to the 

from two external sources, e.g., the VP/VC Routing sub- desired time of the pending task, the real time task scheduler 

system (the enqueuing process) and the cell multiplexing moves the pending task into a priority queue. The output of 

subsystem (the dequeuing process). Requests to schedule an the real time task scheduler (206) is sorted into a set of 

event result in the generation of a task object inside the event 5 priority task queues (210). The priority task queues are then 

scheduler. At any particular time instant, each data queue has serviced in a head of line priority manner, or in a WRR 

at most one associated task object inside the event scheduler, manner utilizing a priority decoder/Multiplexer (212) to 

Le.. a pending task. Thus, where a queue is empty, there is provide a task output (214) to an external interface (216). 

no associated pending task waiting inside the event sched- The external interface (216) sends a request for the cell to 

uler. If the queue is non-empty, then there is one and only 10 the cell multiplexer (106). The choice of service is based on 

one associated pending task in the event scheduler. The a tradeoff of implementation complexity and product 

maximum number of tasks in the event scheduler at any time requirements. 

instant is equal to the number of queues, and the mini mum For each transmission cell slot, the highest priority task is 

number of tasks in the event scheduler is zero. choscn and used to gen erate a request to service an appro- 

To generate and execute a task, a request to schedule/ 15 prfate data queue, Le.. to fetch one data cell from a specific 

reschedule an event, wherein the request includes a queue qucuc where the queue is unempty. then, in accordance 

ID. is sent to the event scheduler. TVpically, the queue ID is y^fa a cell counter (220). the calculation of the "earliest" 

used as an index to a predetermined set of leaky bucket transmission time for the next cell from the same queue is 

parameters associated with a shaper for an associated queue. determined. 

^ fzonthm is known in the art and is defined 20 nQ 3 numeral 300. is a flow chart showing one embodi- 

^^ ^^'^^r S ^ C i a o^° ' ment of steps for a method for scheduling transmission times 

HaU * I993 ' for a plurality of cells on an outgokgUnk for a communi- 

77-89 Then leaky bucket-like algonthms are executed to ^toi nttootk in accordance with the present invention, 

provide * "desired task execution time and a task priority Tfae includes: A) utilizin a cell ^ mcmory 

In general, for all service categories me ^inputed desired * having a memory controller for storing the plurality of cells 

task exectmon time is the earliest allowed time for trans- m (302); md B) utili2mg a 

immng the next data cell for a Virtual .cc^ecaon (VC) ^ Scheduler for scheduling transmission 

without violating the traffic contract associated withttie VC ^ fof ae jurality of cells based on prior actual trans- 
For example, for the CBR service categcry^thc PCR and q ^ of at least one ious ceU (30 4). Typically. 

CDV specify the re^ spacing in tune betweeaatime 30 ^ communication ^an asynchronous transmis- 

senes cells. For the VBR service category the PCR. SCR. network. The cell buffer memory may be located 

and MBS traffic paiarr^as specify a conforming traffic in an ingress port, an egress port, or a central memory of a 

source, A task data object, which contains an implicit time cent^y buffered switch. 

stamp indicating the desired execution time, task priority. ' , ^ . , _ 

IndTueue ID is input to the real time task scheduler/calendar 35 TO- ^ numeral 400, is a block diagram of an event 
queue. The real time task scheduler stores the task object scheduler for scheduling traiismission times for a plunOity of 
until the desired task execution time. When the cell counter an ^ for a comrrumication network in 
(220). Le., a real time clock, increments to the desired time accordance with the present invention. The event scheduler 
of the pending task, the real time task scheduler moves the ***** at least a first ceU buffer memory (402) having a 
pending task into the corresponding priority queue; At each 40 memory controller coupled to receive the plurality of ceUs. 
cell clock, a priority decoder/multiplexer removes a single stonn S * c f Us » ^connection queues, scheduhng 
toskfromme^orityqueuesus^^^ ** and ^-scheduling even*; and at least a first 
(HOLP). THe queue ID is passed through the external mulc P lc «*°**a (^ coupled to the at 
interface to the cell multiplexer. Thus, the event scheduler lcast ^ c <* me f°^ f° r scheduling transition 
sends a time series of events to the cell multiplexer, where 45 Umes for me of ceUs 11 ba !^ 0n ^ tranS ; 
theseriesof events are a set of queue ffis mat spedry a valid- ™ s f> n <* P^ V10US ^ ™ e .communication net- 
sequence of cells that fulfill predetermined traffic contracts work is an asynchronous transmission mode network, 
for every VPCWCC (virtual path coimection/virtual circuit Genm!* the cell buffer memory is located in an ingress 
connection). Traffic shaper calculations are implemented in port of a switch, an egress port of a switch, or a central 
the desired task execution time unit (204). 50 mcm0IV of a wherem me 15 centraU y buffcre(1 
FIG. 2, numeral 200, is a block diagram of an event The memory controller (402) typically includes one or 
scheduler in accordance with the present invention. In the more of the following capabilities: 1) memory allocation 
preferred embodiment of the present invention, cells are between a plurality of logical cell data queues, 2) link list 
enqueued in per connection data queues in one or more cell processing for implementing per VC and/or per service 
memories. Then the "first arrival" cells are broadcast to an 55 category cell data queues, and 3) congestion control mecha- 
external interface (202) of the scheduler so that the sched- nisms which can include the marking and or discard of cells 
uler schedules a first request. A "first arrival" cell is defined originating from sources which are not compliant with their 
to be a cell that arrived at an empty data queue. Then the negotiated traffic contracts. 

history of the arrival time, past transmission times, service The multiservice category scheduler (404) typically 

category, and present state information are used to calculate 60 includes a calculation unit (204). for calculating a desired 

(204) the "earliest" transmission time for the next cell, transmission time of each cell and outputting a task; at least 

which transmission time is inserted into a real time task a first real time task scheduler (206), coupled to calculation 

scheduler (206). Typically, the queue ID is used as an index unit (204), for using the desired transmission time to gen- 

to a predetermined set of leaky bucket parameters (208) erate a task at the desired traiismission time and placing the 

utilized for a shaper for an associated queue (104). The real 65 task into a set of priority task queues (210); a priority 

time task scheduler stores the task object until the desired decoder/MUX (212). coupled to the at least a first real time 

task execution time (TIME EARLIEST). When the cell task scheduler (206). for, at a transmission opportunity, 
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removing at most one task from the set of priority task invention. The method includes the steps of: A) enqueuing 

queues and outputting a request to the memory controller (or discarding if the data queue is congested) (602). by a 

(402) to service a specific cell queue. A cell clock (218) is memory controller, the cells in a plurality of per connection 

typically coupled to the real time task scheduler (206). the data queues in at least one cell memory, wherein each queue 

priority decoder/MUX, and the cell counter (220) to signal a has a queue ID; B) notifying (604). by the memory 

the priority decoder/MUX to remove a single task from the controller, at least one multiservice category scheduler, 

priority queues. The cell counter (220) is a real time clock where a data queue is empty immediately prior to the 

which, when incremented to the desired time of the pending memory controller enqueuing the cells, that a first arrival has 

task, signals the real time scheduler (206) to move the occurred; C) calculating (606), by a calculation unit of the 

pending task into a corresponding priority queue. The cell io multiservice category scheduler, using service category and 

counter value (Time Now) is also made available to the present state information associated with a connection stored 

calculation unit (204) for calculation of the desired trans- in a per connection context memory, an earliest transmission 

mission times (Time Earliest) of cells. time. TIME EARLIEST and an updated PRIORITY INDEX 

FIG. 5, numeral 500. is a functional view of the event updating and storing present state information in a per 

scheduler for scheduling transmission times for a plurality of « connection context memory; D) generating (608), by the 

cells on an outgoing link for a communication network in calculation unit, a "task" wherein the task includes: Dl) the 

accordance with the present invention. The memory con- *l ucuc D>; D2 > me ™E EARLIEST; and D3) the PRIOR- 

troller (402) partitions the cell buffer memory (402) into per m INr>EX ' E) inserting (610) the task into one of a least 

virtual connection queues (508). In FIG. 5, only one logical a 6x51 calendar queue; F) storing (612). by the calendar 

queue is shown ( for clarity), but in specific emrxniirnents, 20 queue, at the calculated TIME EARLIEST, the task in one 

the memory controller would typically partition the memory of a P 1 "^^ of priority task queues; G) removing (614), by 

into multiple logical queues, where the queues may be either a priority task decoder, at a time equal to or greater than 

one queue per virtual connection, or possibly, one queue per TIME EARLIEST in accordance with a time opportunity, 

service category the task from the priority task queue and generating a request 

Other possibilities exist Furthers, the partition of cell * to the memory crandler. H) dequeuing (616) the ceU by 

buffer memory (402) into logical data queue! (508) may be and transnuttmg the cell; I) notifying 

i.i-i-/ ™- ™>r?«Ki- „„*..\~ rtrt«*n (618). by the memory controller, where more cells remain to 

fixed length queues or variable length queues when the ^ traiisrnitted, the multiservice category scheduler that the 

memory controller (402) includes dynamic memory alloca- muiuscrvicccai^oiy 5 ^°"^ " c 

don capability through use of weU known link list data *f ^f 4 ? 0 * <P\« e * ^f^^t^^J^ 20 ^ b * 

structur 30 the calculation unit an updated TIME EARLIEST and an 

CS " . ^ updated PRIORITY INDEX based on service category and 

When a cell (502) arrives at the cell memory (402), the Jaescni state information associated with the connection, 

memory controller makes a decision to either store the cell and updating and storing present state information in the per 

in the logical queue (508), or else, to discard the celt The connection context memory; K) generating (622). where the 

cperaUon pf discardrngaceDisunplementedby not storing 3J connection queue is unempty, a new task using the 

the cell in the cell buffer memory (402). This would result updated TIME EARLIEST, by the calculation unit for the 

in the "loss" of the cell by the network as far as the ultimate connection and returning to step E, and otherwise, where the 

destination is concerned, and should be avoided whenever ^ connection queue is empty, waiting for the notification 

possible. The discard decision may, for example, be based (£04) oy mc memory controller and returning to step C. 

THH? < 51 ,°] which « C maXin T 1 <° FIG- 7, nurneral 700. shows additional steps for utilizing 

length allowed for a logical data queue (508). If storing the mc mcthod of ^ nt invention in constant bit rate 

data cell would cause the queue to exceed & c rmximnm (CBR) avaflaWc ^ ratc {ABR) variaWc bit mc (VBR) 

queue length specifled by threshold (510 teen the cell is and unspecified bit rate (UBR) packet traffic in a cell-based 

discarded, else, the cell is stared in fee cell buffer memory. switch . Fccconstant bit rate. CBR. packet traffic in a packet 

Tne discard decision inayalso be setecdve. F«e«roplc. if <} swftch ^ 620 (702) upfctingllME EARLIEST 

fte cell (S«) conteu* a CLP (cell ^cart pnonty bit) then m - a predetermined function of one or more of the 

the state of the CLP bit in the cell (502) may result in the ae <,£iatod traffic parameters for the connection (PCR. 

memory controller (4*2) using one of two diffcrenl . queue ojv), the present value of the real time clock TIME NOW 

Arcsholds (i.e.^10 orS12) to decide whether or notthe ceU ^ sWe Monmkn associated with the connection that is 

(592) should be stored in the ^logical queue (508). For „ stored in the per connection context memory. For available 

examrJ^consider the caseiUiistrated in FIOS where cells bit ratc , abr, packet traffic in a packet switch, the following 

504; 506) are , afready stored in «Uqueue (508) when cell (7g4) areincluded in step 620: A) updating TIME 

(502)arnves.ffmeCLPtetinceU(502)isequalto»r.then ^RlW using a predetermined function the negoti- 

* e t *^™ n *^" Wm tl T h0W (51 i?i 0 *! ated traffic parameters for the connection (i.e.. the negotiated 

^^^^ok^T^S?™^^ 8 ^ * PCR and MCR), the present value of a real time clock TIME 

fte celL If the CLP bit in the ceU($02) is equal to y , then NOW and associated Wterrained state information (such 

* e n«may controller will use the threshold 510) to make as the previously computed TTME EARLIEST) that is stored 

*e discard decision, and the resulting decision wul be to ^^^^^00 memory; B) using a predeter- 

store trie ceu. mined algorithm, such as a leaky bucket algorithm, to 

In FIG. 5, the scheduler (514) is shown as a "dock" which « determine if the actual transmission packet rate at the output 

paces or governs the cell transmission times from the logical 0 f the packet multiplexer is falling below the negotiated 

data queues (508). Logically, the scheduler can be view as minimum packet rate. MCR, for the connection; and Q 

the device which fetches the cells from the cell buffer. jetting the PRIORITY INDEX to one of at least two 

FIG. 6. numeral 600. is a flow chart showing another different priority levels as a predetermined function of the 

embodiment of steps of a method for scheduling transmis- 63 actual packet rate determined in step B. For variable bit rate, 

sion times for a plurality of cells on an outgoing link for a VBR. packet traffic in a packet switch, the following steps 

communication network in accordance with the present (706) are included in step 620: A) using a predetermined 
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algorithm to determine whether the actual transmission 
packet rate at the output of the packet multiplexer falls 
below a negotiated sustainable packet rate, SCR, for the 
connection; B) using a predetermined algorithm to deter- 
mine whether an actual transmission packet rate at an output 
of the packet multiplexer is exceeding a burst limit, MBS* 
for the connection; Q updating TIME EARLIEST using a 
predetermined function of one or more of the negotiated 
traffic parameters for the connection (PCR, CDV. SCR, 
MBS), a present value of a real time clock TIME NOW, 
outputs of steps A and B above, and prexletermined associ- 
ated state information for the connection that is stored in the 
per connection context memory; and D) setting the PRIOR- 
ITY INDEX to one of at least two different priority levels as 
a predetermined function of the actual transmission packet 
rate at the output of the packet multiplexer determined in 
steps A and B. For UBR packet traffic in a packet switch, 
step 620 includes updating (708 TIME EARLIEST to TIME 
NOW plus packet period, where packet period is a reciprocal 
of a peak packet rate and storing updated TIME EARLIEST 
in the per connection context memory. 

Also, as shown in FIG. 8. numeral 800. for constant bit 
rate (CBR) packet traffic in a cell-based switch, the follow- 
ing steps are included: A) in step 606. on first cell arrival, 
where a TIME NOW is greater than TIME EARLIEST, 
updating (802) TIME EARLIEST equal to TIME NOW, 
where TIME NOW is an output of a real time clock, and 
storing updated TIME EARLIEST in a per connection 
context memory and B) in step 620, updating (804) TIME 
EARLIEST to TIME EARLIEST plus cell period, where 
cell period is a reciprocal of a peak cell rate and storing 
updated TIME EARLIEST in the per connection context 
memory. The PRIORITY INDEX value of steps 606 and 620 
of FIG. 6 is typically initialized to a fixed CBR-priority 
value and remains unchanged. 

FIG. 9. numeral 900, illustrates a timeline for the opera- 
tion of a Scheduler utilizing the specific steps of FIG. 8 for 
a CBR connection. Arrows (902, 904, 906, 908 and 910) 
denote cell arrival times, where time is assume to evolve 
from left to right In the first step (802) of FIG. 8. on first 
arrival (902). where TIME NOW is assumed to be greater 
than a previously computed or initialized TIME EARLIEST, 
TIME EARLIEST (912) is set to the value of TIME NOW 
when the cell (910) arrived. The cell which arrived at time 
zero (902) is shown as being transmitted at an actual time 
(920). Note that the transmission time (920) is shown to be 
slightly after the scheduled time (912). This would occur due 
to possible contention in priority queues (210) in the sched- 
uler (200). However, for the CBR traffic class which typi- 
cally has highest priority in the priority decoder (212), the . 
delay between the scheduled time (912) and actual trans- 
mission time (920) may be engineered to be small. At the 
actual transmission time (920), when the cell is transmitted, 
TIME EARLIEST is updated per the second step of FIG. 8 
(804) to time TIME EARLIEST plus the reciprocal of the 
PGR. Thus, the calculated TIME EARLIEST for the second 
cell (904) is after a time period of 1/PCR (914). This process 
continues until the data queue is empty. In the illustration, 
five cells are shown arriving to the queue, and five computed 
TIME EARLIEST and five actual transmission times are 
illustrated. The salient features illustrated are the following: 
1) The scheduler smoothes CBR traffic in the sense that the 
cells are transmitted in an almost perfectly evenly spaced 
time intervals (1/PCR) even when the cells arrive with 
considerable cell jitter. This is possible through the use of the 
per VC cell queue, buffering a few cells (note cell length 
illustrated in FIG. 9) and the Scheduler which paces cells out 
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at the uniformly spaced scheduled transmission times 
(TIME EARLIEST). 2) The combination of the per VC data 
queues implemented by the memory controller and the 
scheduler also isolates various traffic sources in a data 

5 network, guaranteeing that sources which obey their traffic 
contract will not be affected by sources which violate their 
traffic contract This may be observed from FIG. 9 by noting 
what happens to the queue length when three closely spaced 
cells (904, 906, and 908) arrive. The queue length starts to 
increase. In the illustrated case (FIG. 9). the queue length 
does not continue to grow to a large value because the 
average cell rate over several cell time periods docs not 
exceed the PCR. However, if a source continued to send at 
a rate exceeding the PGR for a sustained period of time, the 
queue length would continue to grow since the Scheduler 

15 would limit the out going rate to the negotiated PCR. If the 
memory control sets the queue threshold value (510) to a 
small value ( a few cells for CBR service category), then the 
memory controller will discard cells from non-compliant 
sources. 

20 As shown in FIG. 10, numeral 1000. for unspecified bit 
rate (UBR) packet traffic in a cell-based switch, the follow- 
ing steps are included: A) in step C, on first cell arrival, 
where a TIME NOW is greater than TIME EARLIEST, 
updating (1002) TIME EARLIEST equal to TIME NOW, 
23 where TIME NOW is an output of a real time clock, and 
storing updated TIME EARLIEST in a per connection 
context memory and B) in step J, updating (1004) TIME 
EARLIEST to TIME NOW plus cell period, where cell 
period is a reciprocal of a peak cell rate and storing updated 
3Q TIME EARLIEST in the per connection context memory. 
The PRIORITY INDEX value of steps 606 and 620 of FIG. 
6 is typically initialized to a fixed UBR-priority value and 
remains unchanged. 
As shown in FIG. 11, numeral 1100, for available bit rate 
35 (ABR) packet traffic in a cell-based switch, the following 
steps are included: 
A) in step C (606) of FIG. 6, on first cell arrival, where 
a TIME NOW is greater than TIME EARLIEST, 
Al) updating (1102) TIME EARLIEST equal to TIME 
40 NOW, where TIME NOW is an output of a real time 

clock, and storing updated TIME EARLIEST in a 
per connection context memory and 
A2) setting a RESET FLAG to TRUE in a per connec- 
tion context memory; 
45 B) in step J (620). including (1104): 
Bl) one of Bla-Blb: 

B la) where RESET FLAG is equal to TRUE, setting 
RESET FLAG to FALSE and setting THRESH- 
OLD equal to TIME EARLIEST plus {a prede- 
50 termined constant times a reciprocal of a prede- 

termined minimum cell rate} in the per connection 
context memory; and 
Bib) where RESET FLAG is equal to FALSE, 
setting THRESHOLD equal to THRESHOLD 
55 plus a pxdetennined reciprocal of a minimum cell 

rate; 

B2) updating (1006) TIME EARLIEST to TIME NOW 
plus cell period, where cell period is a reciprocal of 
a peak cell rate and storing updated TIME EARLI- 
60 EST in the per connection context memory; and 

B3) where notified in step I (618) that a per connection 
cell queue was unempty, including (1106): 
B3a) where TIME NOW is greater than 
THRESHOLD, setting the PRIORITY INDEX to 
65 a value indicating a high priority ABR task queue; 

B3b) where TIME NOW is less than or equal to 
THRESHOLD, 
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B3bl) setting Che PRIORITY INDEX to a value 
indicating a normal priority ABR task queue; 
.and 

B3b2) where THRESHOLD is greater than TIME 
NOW plus {a predetermined constant multi- 5 
plied by a reciprocal of a predetermined mini- 
mum cell rate}, setting THRESHOLD equal to 
TIME NOW plus {the constant multiplied by 
the reciprocal of the predetermined minimum 
cell rate}. 

FIG. 1Z numeral 1200. illustrates a timeline for the 10 
operation of a Scheduler utilizing the specific steps of FIG. 
11 for an ABR connection. ABR traffic parameters PGR 
(specifying the peak cell rate) and MCR (specifying the 
minimum cell rate guaranteed by the network) are applicable 
to ABR. FIG. 12 illustrates a data burst of seven cells 13 

arriving to the queue at cell arrival times C160, C161 

, C166. In the first step of FIG. 11 (1102). on first arrival 
C160. where TIME NOW is assumed by be greater than a 
previously computed or initialized TIME EARLIEST. TIME 
EARLIEST C170 is set to the value of TIME NOW when 20 
the cell C160 arrived. The first cell is actually transmitted at 
time C1S0. Again this is often later man the scheduled time 
C170 due to contention in the priority queues (210) between 
various connections. Especially for ABR connections, the 
time between the scheduled transmission times (C170. 25 

C171 C176) and the actual transmission times (C180. 

C181 CI 85) may be considerable, and variable (as 

illustrated) due to the fact the ABR is typically given lower 
priority in the priority decoder (212). 

When the first cell is actually transmitted C180. the reset 30 
flag is True (1104). resulting in the setting of the threshold 
variable to TIME EARLIEST plus a predetermined constant 
times the reciprocal of the MCR resulting in a first setting of 
the Threshold variable to time C190. The scheduler also 
calculates a new TIME EARLIEST C171. The scheduler 35 
determines the priority for the ABR task by comparing the 
real time clock TIME NOW at the actual transmission time 
C180 with the just computed value of the THRESHOLD 
variable C190. If the Threshold value is larger, then the 
priority is set to Normal _ABR_Priority, otherwise, the 40 
priority is set to "Hi_ABR_priority n . For the "first" ceil 
illustrated in FIG. 11. the priority is set to "Normal" since 
the THRESHOLD C190 is larger than TIME NOW C180. 

FIG. 12 illustrates the assumed time evolution of the 
variou s variables. Note that for the third and fourth cells . that 45 
there is a large time delay between the scheduled transmis- 
sion times (C172 and C173) and the actual transmission 
times (CI 82 and C183). This may be caused by a higher 
priority traffic source (such as a VBR source) starting to 
transmit a celL or by multiple other ABR sources starting to 50 
transmit cells through the same part resulting in contention 
in priority queues (210). Note that at actual transmission 
time C1B3, that when the scheduler compares the actual 
present time C183 with the just computed value of the 
threshold C193. that the actual TIME NOW is greater than 55 
the THRESHOLD, therefore the scheduler has detected that 
the average cell rate of this ABR connection is falling behind 
guaranteed MCR for the connection, as a result, the priority 
C150 for this ABR connection is momentarily increased to 
HL^ABmriority which will increase the priority of this 60 
connection in priority decoder (212). This will decrease the 
delay between subsequent scheduled transmission times 
(C174 and C175) and actual transmission times (C184 and 
C185) until the scheduler detects that the connection is 
meeting or exceeding its minimum cell rate, at which time 65 
the scheduler will decrease the priority to Normal as illus- 
trated. 
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As shown in FIG. 13. numeral 1300, for variable bit rate 
(VBR) packet traffic in a cell-based switch, the following 
steps are included: 

A) in step 606 (1302), on first cell arrival, where a TIME 
NOW is greater than TIME EARLIEST, 

Al) updating TIME EARLIEST equal to TIME NOW, 
where TIME NOW is an output of a real time clock, 
and storing updated TIME EARLIEST in a per 
connection context memory and 

A2) setting a RESET FLAG to TRUE in a per connec- 
tion context memory; 

B) in step 620 (1304). 

Bl) where RESET FLAG is equal to TRUE. 
Bla) setting RESET FLAG to FALSE 
Bib) and setting THRESHOLD equal to TIME 
EARLIEST plus {a rjred^ermined constant times 
a reciprocal of a predetermined sustainable cell 
rate} in the per connection context memory; 
Blc) and where a theoretical transmission time TTT 
is less than TIME NOW, setting TTT=TIME 
NOW; and where RESET FLAG is equal to 
FALSE, setting THRESHOLD equal to THRESH- 
OLD plus a reciprocal of the predetermined sus- 
tainable cell rate (SCR); 
B2) updating TIME EARLIEST to TIME NOW plus 
cell period, where cell period is a reciprocal of a 
predetermined peak cell rate (PCR) and storing 
updated TIME EARLIEST in me per connection 
context memory; and 
B3) where notified in step 618 mat a per connection cell 
queue was unempty, 

B3a) updating a theoretical transmission time (TTT) 
to a value of TTT plus the reciprocal of the 
sustainable cell rate (SCR) and storing the updated 
TTT in the per connection context memory; 
B3b) and one of B3bl-B3b2: 

B3bl) TIME NOW is greater than 
THRESHOLD, setting the PRIORITY INDEX 
equal to a value indicating a high priority VBR 
task queue; 

and B3b2) where TIME NOW is less than or 
equal to THRESHOLD, 
B3b2a) setting the PRIORITY INDEX equal to 
value indicating a normal priority VBR task 
queue; 

B3b2b) where THRESHOLD is greater than 
TIME NOW plus a predetermined constant 
times a reciprocal of a predetermined sustain- 
able cell rate (SCR), setting THRESHOLD 
equal to TIME NOW plus a rxedetermined 
constant times a reciprocal of a predetermined 
sustainable cell rate (SCR), 
B3b2c) where TIME EARLIEST is less than 
TTT minus a predetermined maximum burst 
size constant TMBS, setting TIME EARLIEST 
equal to TTT minus a predetermined maximum 
burst size constant TMBS. 
FIG. 14, numeral 1400. is a flow chart showing one 
embodiment of steps for priority decoding in accordance 
with the present invention. The steps include: A) utilizing 
(1402) a set of priority task queues and a head of line priority 
decoder/demultiplexer at the output of the task queues; B) 
utilizing (1404) a set of priority task queues and a priority 
decoder/demultiplexer arranged to provide a combination of 
head of line priority and weighted round robin queuing 
disciplines. 

The present invention may be embodied in other specific 
forms without departing from its spirit or essential charac- 
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teristics. The described embodiments are to be considered in 
all respects only as illustrative and not restrictive. The scope 
of the invention is. therefore, indicated by the appended 
claims rather than by the foregoing description. All changes 
which come within the meaning and range of equivalency of 
the claims are to be embraced within their scope. 
I claim: 

1. A method for scheduling transmission times for a 
plurality of packets on an outgoing link for a communication 
network, comprising the steps of: 

A) enqueuing, by a memory controller, the packets in a 
plurality of per connection data queues in at least one 
packet memory, wherein each queue has a queue ID; 

B) notifying, by the memory controller, at least one 
multiservice category scheduler, where a data queue is 
empty immediately prior to the memory controller 
enqueuing the packets, that a first arrival has occurred; 

Q calculating, by a calculation unit of the multiservice 
category scheduler, using service category and present 
state inforraatioD associated with a connection stored in 
a per connection context memory, an earliest transmis- 
sion time, TIME EARLIEST and an updated PRIOR- 
ITY INDEX and updating and storing present state 
information in a per connection context memory; 

D) generating, by the calculation unit, a 'task** wherein 
the task includes: 

Dl) the queue ID; 

D2) the TIME EARLIEST; and 

D3) the PRIORITY INDEX; 

E) inserting the task into one of at least a first calendar 
queue; 

F) storing, by the calendar queue, at the calculated TIME 
EARLIEST, the task in one of a plurality of priority 
task queues; 

G) removing, by a priority task decoder, at a time equal to 
or greater than TIME EARLIEST in accordance with a 
time opportunity, the task from the priority task queue 
and generating a request to the memory controller, 

H) dequeueing the packet by the memory controller and 
transmitting the packet; 

I) notifying, by the memory controller, where more pack- 
ets remain to be transmitted, the multiservice category 
scheduler that the per connection queue is unempty; 

J) calculating, by the calculation unit, an updated TIME 
EARLIEST and an updated PRIORITY INDEX based 
on service category and present state information asso- 
ciated with the connection, and updating and storing 
present state information in the per connection context 
memory; 

K) generating, where the per connection queue is 
unempty, a new task using the updated TIME 
EARLIEST, by the calculation unit, for the connection 
and returning to step E, and otherwise, where the pa- 
connection queue is empty, waiting for the notification 
by the memory controller and returning to step C. 

2. The method of claim 1 wherein the step of enqueuing 
the packets includes determining whether to enqueue/ 
discard a packet in accordance with a predetermined scheme 
for. where at least one source malfunctions, maintaining a 
predetermined quality of service for other sources. 

3. The method of claim 2 wherein the predetermined 
scheme includes one of: 

A) discarding a packet where a maximum queue length 
specified by a threshold is exceeded by storing the 
packet in a queue; and 
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B) discarding the packet in accordance with a predeter- 
mined selective scheme. 

4. The method of claim 1 including, for constant bit rate. 
CBR. packet traffic in a packet switch, in step J. updating 
TIME EARLIEST using a predetermined function of the 
negotiated traffic parameters for the connection, the present 
value of the real time clock TIME NOW and state informa- 
tion associated with the connection that is stored in the per 
connection context memory. 

5. The method of claim 1 wherein, for CBR packet traffic 
in a packet switch, including the steps of: 

A) in step C, on first packet arrival, where a TIME NOW 
is greater than TIME EARLIEST, updating TIME 
EARLIEST equal to TIME NOW, where TIME NOW 
is an output of a real time clock, and storing updated 
TIME EARLIEST in a per connection context memory 
and 

B) in step J. updating TIME EARLIEST to TIME EAR- 
LIEST plus packet period, where packet period is a 
reciprocal of a predetermined peak packet rate and 
storing updated TIME EARLIEST in the per connec- 
tion context memory. 

6. The method of claim 1 wherein, for UBR packet traffic 
in a packet switch, including the steps of: 

A) in step C, on first packet arrival, where a TIME NOW 
is greater than TIME EARLIEST, updating TIME 
EARLIEST equal to TIME NOW, where TIME NOW 
is an output of a real time clock, and storing updated 
TIME EARLIEST in a per connection context memory 
and 

B) in step J, updating TIME EARLIEST to TIME NOW 
plus packet period, where packet period is a reciprocal 
of a predetermined peak packet rate and storing 
updated TIME EARUOESTT in the per connection con- 
text memory. 

7. The method of claim 1 wherein, for available bit rate. 
ABR, packet traffic in a packet switch, the following steps 
are included: 

A) in step J, updating TIME EARLIEST using a prede- 
termined function of the negotiated traffic parameters 
for the connection, a present value of a real time clock 
TIME NOW and associated predetermined state infor- 
mation that is stored in the per connection context 
memory; 

B) in step J. using a predetermined algorithm, such as a 
leaky bucket algorithm, to determine if the actual 
transmission packet rate at the output of the packet 
multiplexer is falling below the negotiated minimum 
packet rate, MCR. for the connection; and 

C) in step J, setting the PRIORITY INDEX to one of at 
least two different priority levels as a predetermined 
function of the actual packet rate determined in step B. 

8. The method of claim 1 wherein, for ABR packet traffic 
in a packet switch, including the steps of: 

A) in step C, on first packet arrival, where a TIME NOW 
is greater man TIME EARLIEST, 

Al) updating TIME EARLIEST equal to TIME NOW, 
where TIME NOW is an output of a real time clock, 
and storing updated TIME EARLIEST in a per 
connection context memory and 
A2) setting a RESET FLAG to TRUE in a per connec- 
tion context memory; 

B) in step J, 
Bl) one of Bla-Blb: 

B la) where RESET FLAG is equal to TRUE, setting 
RESET FLAG to FALSE and setting THRESH- 
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OLD equal to TIME EARLIEST plus {a prede- 
termined constant times a reciprocal of a prede- 
termined minimum packet rate} in the per 
connection context memory; and 
Bib) where RESET FLAG is equal to FALSE, 5 
setting THRESHOLD equal to THRESHOLD 
plus a reciprocal of a predetermined minimum 
packet rate; 

B2) updating TIME EARLIEST to TIME NOW plus 
packet period, where packet period is a reciprocal of 10 
a peak packet rate and storing updated TIME EAR- 
LIEST in the per connection context memory; and . 

B3) where notified in step I that a per connection packet 
queue was un empty. 

B3a) where TIME NOW is greater than is 
THRESHOLD, setting the PRIORITY INDEX to 
a value indicating a high priority ABR task queue; 

B3b) where TIME NOW is less than or equal to 
THRESHOLD, 

B3bl) setting the PRIORTTV INDEX to a value 20 
indicating a normal priority ABR task queue; 
and 

B3b2) where THRESHOLD is greater than TIME 
NOW plus {a predetermined constant multi- 
plied by a reciprocal of a predetermined mini- 25 
mum packet rate}, setting THRESHOLD equal 
to TIME NOW plus {the constant multiplied 
by the reciprocal of the predetermined mini- 
mum packet rate}. 

9. The method of claim 1 wherein, for variable bit rate. 30 
VBR. packet traffic in a packet switch, the following steps 
are included: 

A) in step J. using a predetermined algorithm to determine 
whether the actual transmission packet rate at the 
output of the packet multiplexer falls below a negoti- 35 
ated sustainable packet rate. SCR* for the connection. 

B) in step J. using a predetermined algorithm to determine 
whether an actual transmission packet rate at an output 
of the packet multiplexer is exceeding a burst limit, 
MBS. for the connection; 40 

Q in step J. updating TIME EARLIEST using a prede- 
termined function of negotiated traffic parameters for 
the connection, a present value of a real time clock 
TIME NOW, outputs of steps A and B above, and 45 
predetermined associated state information for the con- 
nection that is stored in the per connection context 
memory; 

D) in step J. setting the PRIORITY INDEX to one of at 
least two different priority levels as a predetermined ^ 
function of the actual transmission packet rate at the 
output of the packet multiplexer determined in steps A 
and B. 

10. The method of claim 1 wherein, for VBR packet traffic 

in a packet switch, including the steps of: 55 

A) in step C, on first packet arrival, where a TIME NOW 
is greater than TIME EARLIEST. 

A 1) updating TIME EARLIEST equal to TIME NOW, 
where TIME NOW is an output of a real time clock, 
and storing updated TIME EARLIEST in a per go 
connection context memory and 

A2) setting a RESET FLAG to TRUE in a per connec- 
tion context memory; 

B) in step J, 

Bl)one of Bla-Blb: 63 
Bla) where RESET FLAG is equal to TRUE, 
Blal) setting RESET FLAG to FALSE and 
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Bla2) setting THRESHOLD equal to TIME 
EARLIEST plus {a predetermined constant 
times a reciprocal of a piedeterrnined sustain- 
able packet rate} in the per connection context 
memory; 

B la3) and where a theoretical transmission time 
TTT is less than TIME NOW. setting TTT= 
TIME NOW; and 
Bib) where RESET FLAG is equal to FALSE, 
setting THRESHOLD equal to THRESHOLD 
plus a predetermined reciprocal of the predeter- 
mined sustainable packet rate; 
B2) updating TIME EARLIEST to TIME NOW plus 
packet period, where packet period is a reciprocal of 
a peak packet rate and storing updated TIME EAR- 
LIEST in the per connection context memory; and 
B3) where notified in step I that a per connection packet 
queue was unempty, 

B3a) updating TTT to a value of TTT plus the 
reciprocal of the sustainable packet rate and stor- 
ing the updated TTT in the per connection context 
memory; 
B3b) one of B3bl-B3b2: 

B3bl) where TIME NOW is greater than 
THRESHOLD, setting the PRIORITY INDEX 
equal to a value indicating a high priority VBR 
task queue; 

B3b2) where TIME NOW is less than or equal to 
THRESHOLD. 

B3b2a) setting the PRIORITY INDEX equal to 
value indicating a normal priority VBR task 
queue; 

B3b2b) where THRESHOLD is greater than 
TIME NOW plus a predetermined constant 
times a reciprocal of a predetermined sustain- 
able packet rate, setting THRESHOLD equal 
to TIME NOW plus a predetermined constant 
times a reciprocal of a predetermined sustain- 
able packet rate, and 

B3b2c) where TIME EARLIEST is less than 
TTT minus a predetenriined maximum burst 
size constant TMBS. setting TIME EARLIEST 
equal to TMBS. 

11. the method of claim 1 wherein priority decoding 
includes one of: 

A) utilizing a set of priority task queues and a head of line 
priority decoder/demultiplexer at the output of the task 
queues; 

B) utilizing a set of priority task queues and a priority 
decoder/demultiplexer arranged to provide a combina- 
tion of head of line priority and weighted round robin 
queuing disciplines. 

12. A method for scheduling transmission of a packet the 
method comprising the steps of: 

detenmning. upon receipt of said packet a corresponding 

per-connection queue for said packet; 
determining, upon determination of the corresponding 

per-connection queue, whether said per-connection 

queue is empty; 
generating, upon determination that said per-connection 

queue is empty, a request for scheduling said packet; 
calculating at least a desired execution time and a priority 

for said request; 
storing said request until at least the desired execution 

time; and 

storing said request in one of a plurality of priority queues 
corresponding to the priority calculated for the request 
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13. The method of daim 12 further comprising the step of: 
selecting one request for each of a plurality of cell 

transmission times from among a number of requests 
stored in the plurality of priority queues. 

14. The method of claim 13 further comprising the steps 
of: 

retrieving, upon selecting a request, a corresponding 
packet from its corresponding per- connection queue; 

determining, upon retrieving the corresponding packet 
from its corresponding per-connection queue, whether 
said per-connection queue is non-empty; and 

generating, upon determination that said per-connection 
queue is non-empty, a request for scheduling a next 
packet from said per-connection queue. 

15. An event scheduler for scheduling transmission times 
for a plurality of packets, the event scheduler receiving a 
request for each packet to be scheduled the event scheduler 
comprising: 

a priority queue for each of a plurality of priorities 
supported by the event scheduler, 

logic for calculating at least a desired execution tune and 
a priority for each request; and 

a real time task scheduler, responsive to a real time clock, 
for determining when the real time clock is at least 
equal to the desired execution time of a request and, 
upon said determination, for storing said request in a 
corresponding priority queue. 

16. The event scheduler of claim 15 further comprising: 
a cell clock for signaling each successive cell transmis- 
sion time; and 

a decoder/MUX, responsive to the cdl clock, for selecting 
one request for each cell transmission time from among 
the requests stored in the plurality of priority queues. 

17. The event scheduler of claim 16 wherein the selected 
request corresponds to the request stored at the head of the 
highest priority non-empty priority queue. 

18. An apparatus for scheduling transmission times for a 
plurality of packets, the apparatus comprising: 

a per-connection queue for each of a plurality of connec- 
tions supported by the apparatus; 

logic for determining, upon receipt of each packet, a 
corresponding perconnection queue for said packet; 

logic for detennining, upon determination of the corre- 
sponding per-connection queue, whether said per- 
connection queue is empty; , 

logic for generating, upon detennin&lion mat said per- 
connection queue is empty, a request for scheduling 
said packet; 

logic for calculating at least a desired execution time and 

a priority for said request; 
logic for storing said request until at least the desired 

execution time; and 
logic for storing said request in one of a plurality of 

priority queues corresponding to the priority calculated 

for the request. 
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19. The apparatus of claim 18 further comprising: 
logic for selecting, for each cell transmission time, one 

request from a number of requests stored in the plu- 
rality of priority queues. 

20. The apparatus of claim 19 further comprising: 
logic for retrieving, upon selecting a request a corre- 
sponding packet from its corresponding per-connection 
queue; 

logic for determining, upon retrieving the corresponding 
packet from its corresponding per-connection queue, 
whether said per-connection queue is non-empty; and 
logic for generating, upon determination that said per- 
connection queue is non-empty, a request for schedul- 
ing a next packet from said per-connection queue. 

21. An apparatus comprising a computer usable medium 
having computer readable program code means embodied 
therein for scheduling transmission times for a plurality of 
packets, the computer readable program code means com- 

20 Fri^ 

computer readable program code means for determining, 
upon receipt of each packet, a corresponding per- 
connection queue for said packet; 
computer readable program code means for determining, 
upon determination of the corresponding per- 
connection queue, , whether said per-connection queue 
is empty; 

computer readable program code means for generating, 
upon determination that said per-connection queue is 
empty, a request for scheduling said packet; 
computer readable program code means for calculating at 
least a desired execution time and a priority for said 
request; 

computer readable program code means for storing said 

request until at least the desired execution time; and 
computer readable program code means for storing said 
request in one of a plurality of priority queues corre- 
sponding to the priority calculated for the request. 

22. The apparatus of claim 21 further comprising: 
computer readable program code means for selecting one 

request for each of a plurality of cell transmission times 
from among a number of requests stored in the plurality 
of priority queues. 

23. The apparatus of claim 22 further comprising: 
computer readable program code means for retrieving, 

upon selecting a request, a corresponding packet from 
its corresponding per-connection queue; 
computer readable program code means for determining, 
upon retrieving the corresponding packet from its cor- 
responding per-connection queue, whether said per- 
connection queue is non-empty; and 
computer readable program code means for generating, 
upon determination that said per-connection queue is 
non-empty, a request for scheduling a next packet from 
said per-connection queue. 
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